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(54) RECEIVER 
(57)Abstract: 

PURPOSE: To recover automatically a time lag caused 
from an input to an output to be a proper value by 
adjusting a read speed from a buffer means so as to 
control a difference between a time when a signal is 
received and a time when the signal is reproduced within 
a 1st time and a 2nd time being upper and lower limits. 
CONSTITUTION: A voice and moving picture signal 
received by a network reception section 1 1 is separated 
into voice and video data by a separation circuit 12 and 
they are respectively buffered in voice and video data 
buffer memories 13, 14. In-buffer memory capacity 
measurement circuits 15, 20 detect whether a difference 
D between a time when a signal is received and a time 
when the signal is reproduced is within a 1st time A 
being an upper limit time or a 2nd time B being a lower limit time. Arithmetic discrimination 
circuits 76, 81 adjust a clock speed from read clock generating circuits 17, 22 based on a 
signal representing that the difference D exceeds the time A or is less than the time B 
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outputted from the circuits 15, 20. Thus, the difference D is kept within the times A and B and 
the time lag and the time deviation from the input to the output in the memories 13, 14 are 
recovered automatically to be a proper value. 
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mmmt % ix^pm/xammmm m&t 
im^m^m^mz^x . 

ib»3 w«ai#at:j: ^xtm^pRV/xummm 
mttmm i imngm&w, 

icowttmti z t wmt -tin$% i x\t2ti 

[000 1] 

immMmftm *$hh«. wi.tr. aye*-* 
<r>x-hh. 

[0002] 

#aLoo*4. ttz. mmt. tti^ZruWay 
tztf->x. ±MV*-Vi->\sa ye*-?*??-? xt- 

[ 0 0 0 3 ] £ Z X\ t&fc^V/l^T TOiWlTffl 

^ixhmmmnmi'AT&tLxii. mi 2iz^t 
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[0004] CltfOiai 2fcfcWC. A^SSl 00^1 
0 1 jHaiWiHW*?-*, HBr-^tftfeteSft 

s. £OA^ai o o , i o i b ixu. puifv-r 

D 3 >A*- ? &Wfl Z b tfX'Z l . £?)A:»]§IS 1 0 

o.ioi *»&<0T-*ii. * fi-ehAAT-^jaaK 
a i o 2 , i o 3 ^>ix. zti?timfc<r)T-?ym 

10 #Jfe$ft6 . ^CDATJT-^fflgSl 0 2, 1 0 3T' 

£fc**T#5. ±IBA*r-^ailSl0 2. 103 
a^OffiHT-^i. v^f-ri^^iM 0 4(cJ:-jTv 
/kf-TV^xWaSii, jSHrt^r^U l 0 5tc# 
£6*lfc«fcK*aS*:h.T, h"7-?j*fta5106 
frt>MW -i— hZb'O*"/ YV—9*-ft\^X 

[0005] ±fE*-y b!7-?WISl'l lT'gftSft 
fcr-^tt, Sft^'-yyr^'J 1 1 2{c-H.^x^ii 
20 fc«CK*ai3*u SfefcdMKSai 1 StJroTifE 

. tix. ftXT-fmrnwi i4,ii s^in^ns. 

SKtU*-f-^«H«« 114, 11 5{i±|£A^r- 

^^aajia 102, 103 (aww * r- ^ ttss^aas: 

S6U *<0ttH4S(«l 16,11 7KiiS4. *t». a 
Rff£181 116, 1 1 7 1 LTJi. D/A3^W 

[0006] 

[00073 jfe-f , ±iES!*<7)fi#j!iiaaftv-^f-A(c 
fcv^Ta. 0>ji.{fs«fflo±ieai^.T-^^agai 1 

4,11 5>5rt'coft?tW^I!ltcj:oT^a* { an. Sft 
A'7 7r^fy 1 1 2fc*J^Trt*3&*Jii-f *"*J:dfc 
£W«fc^(c» Sft^'y^r^t'J 1 1 
2«rt«Wiii-jr6 J: 3 t . SKSflP^-x ? r 
^t'J 1 1 2tcfc(tSr-^iOA^* > <oai**'C'<7)^ 

40 [0 0 08] 4fc. Hl2<0WTtt. Sft^'-y7r>c ; E 

Wiv 7 r * t »J IBW WHBWi ( t%h*>* r * r ia 
[00093 £<0fl*<0fcafcovvcJ: ■) AfW(cK« 
50 nv-lfjL-^^ittTJifflLT^^afflT-^^ 
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lim^mictirfflcomftzft-ox^&zt. sic *b 

SOJISr-i^kSfU ^;l^-7«y hTt'ttT'SK l^tf^T. 
*mti%Zco&m#W®£ixhZb. 3rk'cDttff£ft-> 
TVii. 10 

too i o] zcofztb. ztLbz^mmxifcitiibtz 
t±. ^7HH», am, mm. v-vx<m^tiz 

A<4«5: < . ttijlX'CO* T 4 TfflCD&fmcD-rtl t /]n$ V \g 
[0012] 

[RHfclWW-ifctfx^B] *»!Bo«ISa{i±a 
UclWJMtS^tH^^tOTJ)^ B£ 20 

jAmw*m&*tii&mb . **&tf/xii»B*> 
i mrartT-j)!. ; k *«tai-*-*» i o&aj#Kk . * 

^SV/XfilSiioft^off Sfl LfciSIH k co 

gffrmt ixco^comsftx-h&z tmtn-rm 

2C0tfM&f&t . ft#£A.y 7T'J y^&A-y 7 r# 
St . ±ie^*-y 7 r^gj; 0^)K»ffl Lag£f®g U 30 

[ooi3]^c. *&wco%mmm.K. suft-f *h* 

*Xtf/OUi»B*»<flWC**£ k fc*tart-S*3 
«0«liil#aSrtfii^, *J»ft^/Xtt»B«:l»<fi^«r 

t)«rr*t*tc, jjE»3<o«ia5¥atj:-5-c±iEW 
pw/xmmm<m^z%mit:b$izte s 

[ 0 0 1 4 ] £ t>iZ. *fflt<7&mm.\^ §ftf|-f*> 40 

%4 comta^mz x ^x±tm^commm ttz t # 

[00 15] 

mmttzzb. xitrmx'hhm 2 ob^a s-te o 
**bblt, mkmstgmLtztin&bco&t: . mi 50 
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0^kB2**fflrtklfct«»*frd. S 
£s^k§fiUd$igk<Oil#. iBK^iaSraiik 

A-y 7 r^ST-coA^i&^ai^iT^iaa^*^^ < 

m2cOB#raS-THII.k^y7r^g|*Icr)ieit**>' 

'M^<t£*)m'hcox\ mmwib%mLtz#imbcr>m 
tK micommmmitz t )m2commmrmr>fzb 

Sfcti, *<0£*ISl*»SISIrt (US) km2<7)B§Hrt 
(TR) t-fl.£i:t\ A*.y7r*a^A^*^aj*i 

"c«eiaB»i.*aiEfifciiias*s t «tc^' 7 7 

[ 0 0 1 6 ] £ fc, *#!Btf>5Hl§@lfc , $ fefc 
fifi#^*&tf/Xti»B*B<<I#'?*S£ k 

[0017]$ fefc, *#*0»|§MfcJ:*itjr, $ t> 

iz%4 co&m^mmi. zcomicomz^mz^x 
zmm^comfecomz mm ttz t s tc«±. *<rmfe.<n 
mmKfccmftiomt&zbx; a?7t#bw> 
\fifrt> ttjTj * xcmfsrnizmx&mzmiis-th x 
oizi. zcomfecDUMz^xiitcDttwm-t&z 
bx\ z<DmfccD®ftcom^iz'o^ximmi%^£o 

[0018] 

xmm-z. 

[00 1 93 01 ttt, *9MHIItl0l<OSA«8<Offilft 

k ^»fflbgimi2(rt k^&io izn^-ti mmcD% 

■y h7-?gftS51 latX^HtlilSSl 2k. 
*J**W»B^-^ 2: A. y 7 r 'J -y 7 r #a 

k IXCD^jST-f^-vyr*^ D 1 32lV»fllT-^ 
A. y 7 *U 1 4 k , #WUflBBr-^ 2:S4-f l» 

S4#ak ixco%pT-fimA/D$tmmi 8R 

tmgLT - ^#36A/DSaiI5]8Si 9bttLX%h. 

[0020] *»%at«*oa^6Btii. # 
pm/mwiz^xn&zh&m<m£.tii!$b%mz 

tlZ>mmbcr>mtf±m (tmt&Smax, Vmax) 

com 1 wmtrcb&z t 1 com&^&. 

RV%PbMWlz^XW£Ztl&m^con!mf3b i $ 

mzti&mikvgifim («art*smi n. vmi 

. n ) (7j^2 C08imfiX'fo& Z b Sr^aj-TSm 2^ffi^ 
Sfc LXcort -y 7 r * =t 'J rtSfiB^HIifl 15,20 
k. A.y7r-X*Ul*l»*ai&gBl 5. 20frt><?)til 

to&jiizx r>x±%m&fflk%mf3bc>)&tf±si±. 

mZffittzZ k XJiTHSTBofci k Sttaj-tS k . 
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Zffl&ftftfi^^XlMdMi&fflkgmZti&tiffl 

m) tmwm'n mmmm,i e, sit 

7 r^'J 13. l4<7)^tllL^n-y^^^1-^ 

77^'J13, 14<7)!f!*iiJL?n-y73lJ££±ff*: 
0 Tift: V-t&Zt TJJBWWfcfr o . 

[ o o 2 1 1 *wmm<r&mmt. 

i: fcfcifr*- 4»3*>tMHNSi: LTW&ti}l2]S82 5 

ctt. ii^tBiii82 5*^oeiaiai^{c«t:T^iii 

iK4MtLfcaMJ > Ko^Ttt'5*-^«HIEIII2 6lC 

JWIilI*Hi<«*i:LTIi, ^im^ff-? 
. ^ny'^Af-mif-?, ffipA-f-fUf-^ 20 

[ 0 0 2 2 ] $ ^tc. 4^£flOT^ffi8SO±Etfc 

<c>0&!i}ttJ7J$: , JJBftJIWIQrllR 7 6, 8 llzMh . 
iRj|]mKiaR7 6. 8 1 tefekvOL 

y i4t=«LTJjei»jitfD«4Hi-e<o4*«iaL, «iw> 

COO 2 3] ^-IT\ 01 t09~Hl lC^t 
^&^fi<9*f^i:^*>Ki>£TTy *r-^^y • r 

n/^Sy/' 4 >7*7x- X (API :applicationpr 
ogramming interface) t s fflfgJSiaiifl^X-rA^fc 

iHWi. ' ' '40 
[0024] 1 . AHIWIfflBimy^-fAlcfcJtS v/H- 

z<r>ffiwmgim t mmi-&Bmi±. (i) v^v^aH 

2rffio.Ii: s (2) #F^HB<Dfflfi^%<9««it2: . S 
C03ybo-;^t5rff3dt. (3) ^f^7f-W 
tmvtlZb. (4) 7-o-fe -y-t^-y r-V-^&fc'tf) 50 
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y v -wnmnmHzft tx , ft&x%&zb. © 
[0025] ifife<os**»6, ffl»asa(±OTic 

[0026] 1. 1 X? 4 7947 

irawssfSB-ca 3 * r a rf- * fc lt . m*mz\± 

k vyrvyymmkH2.<7)%?i7-fcr)i$r&iz 
a. mimmn 1 /& o o o (sec), %.wmhtz 

[0027] 1. 2 HmfBmSXbX?4T?JUZ 

nmmrnmi. mcox^u x^^r-^i. 

[0 028] XllT'U XbLXte. (1) *-ta*4 
>?7x-X*?\LT*\j}4 y?7x.-Xts:b'cr»\-Y- 
7i7fA*>fX, (2) W>Y7T-i)V*?$m7T4)l 
^A-t'-7r-f /K9 J; p & tiTt-?7t 
-Ok (3) ^f-df-vXr-THVX. (4) tvATVY 
Tn-bZ%b'£y*-h?&. 

[0029] aWUZblXlt* (1) it-f^sM 

y?7i-^7<ymt»fA'^, (2) v^f- 

*T477t4)V. (3) V^f-^-vXhTK^. (4) 
[ 0 0 3 0 ] £>|>*X K£ttflHi«HBji»ifc«— 3Jtf 

4 xm^co^xbizhlZb ijaBk-f 6«^Ctt, 

wmmtTrtxLxmwmm&zmmz-ttz. 
[003 1 ] 1. 3 x s r<t7 j ?-*wm&bmi 

vjH-Xt < 7~>XT£.b lXJ--?t,zm&tm<7)SI> 

n?>msmmbbxuT<oh<otf%z.t>tii. mm. 
(i) mm<r)Mti0)¥f%m&. (2) xTirmmrm® 
mm. (3) ^;i/-r-yh, (4) v-tnxmmztih 

i§r£bmtl%^W>-£X'bh. 
[ 0 0 3 2 ] 4.ft.fc«S»-C8tfi-C* & AK^£ 

4 Xtc b'<r>m.mcom<r)m« <r» i7X—?*ayyu-)V 

+&. tfmmmmwte. timmmmmizfe^x . 

[003 3] 1. 4 *7b7-;7Dh3-^ 

Wh7u-i£b' tmmzay ha-foX-Z h^ifih 

S«tf)*-y hV-^|gti<7)IEEE 8 0 2. 3« 
*BWW!ILfcV^4-f — 9" • ^--y h (Ethernet)^, ffl 

eiMK i so ) <?)sc i 3(;fcv^ril^3^r 
\^h%7 r -i rtZm^tz 1 0 0 M h' -y Y/% V - 7 
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■/ i'V 7-H$&>? r A A* • r 4 X h 'J 4 fjL— f v H • 
• >?7x-X ( FDD I : fiber-distributed 
data interface) hV-fT'U Xti, fl-SSS 

i&b4>?-*yh • TvhZ-fr ( I P:internet 
protocol) imm-fl'Xgtft)*) . *EH4*-v 
ro h ttufci?)|, h S 7 y 3 x • ay 
h Q — )V • V°U h 3— )V (TCP: transmission contro 10 

i protocol) a^^ 3 yuxm^oyvha-)U 

( UD P:user datdgram protocol )£flJ£ILJt. 

[00343 1. 5 -f-^<osmm 
mmmmmi , v 7 h *? x r 4 fcttA- h *? * r 

( CC I TT) ^jS«rSftW|ScOft&G. 7 11, 
G. 72 1, G. 7 2 2, G. 7 2 8&ir<a&1g£lN? 
-Kt*. 4fc, BflUOJEEHi^i LTtt, BUgWHE 20 
l£«81g|B|£JI* (CC I TT) <0^9-»jfcH«!|M- 
^MOlIl^m*ft^^l'-7 I 0^t.t9>§ J P E G(J 
oint Picture Expert Group) ^ ■rl^t'^^> / XTi»ffl 

BBBia^f^PI/^-r^MPEG (Moving Picture E 
xpert Group) ^rt'£7)^*>"S>S. ffi»5r*ri: fcWtttf 
*6*rC\ Jflat J: oTtt^#»t 
[00 3 5] 1. 6 DV-XOny h-o-zP 

Aibumsztm-t&mmzhi. mm. %paiit 30 

(1) -r^TOB*5£C3e-LTSS. 

(2) 5fc*<Og:££iIftL, flHfeoKftfcffifct*. 

(3) ^5-fryh*«a«"3#ii. -74 

[00 3 6] 1. 7 ftfflfA'^OTyho-A' 
#^ilM*if<0v;W7*^Tf-^*aa*&C 40 

r <•* • t'^r^m (av®&) mmtzbtf 

[00 3 7] 2. WfgJtOSgfi^r/l^AP I 

2. 1 Av«is*^$^i»ffif8«iagSo ; eT;p 
tif$8«iaSSBtt, H2fc*t±pfc:, lyATWZti 
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•T. 4-f , ^T®JW#{i (AVobj)tfcV^<R«W^T 
4 TfA'^ (AVdev) Z*-Ty?&. £ttft£ttl&.X 
T-f 7f /V X(AVdev) iifflm%T>U XTttftVVfe 

[00383 4^,03 fcwt J: 3 fc, AAJfHcUHR 
aSftWr^f -f Tr'AM x (AVdev) 5r3j--7V LfcgfrSl 
ffll#ii(AVobj) bUMm^T 4 Tr'V X (AVdev) £ 

*-ryLfcjiffMtMiffl(AVohj) ttifitt-riikfc 

<oHff*jffli#fi(AVobj.) -c*-r y Sfrcus-fA^r x 
m^T4 Tnmmmmtiz . 

[00393 S&K, 04<OJ:d(C*-yb , 7->TO* 

#fi(AVobj) ££j£u iawsittioftirawih 
[00403 i*ft, Sftii^iiff$ijffli#{a(AVobj) m 

-7y?&T'U X (AVdev) fc LTIr^yh'T^M 

rt-ixb LTWH(Movie) 7r-<;PS-^t, aj7Jr^* 
■i xizw > Ht'aM ^. b Vt*t'<4 xi*-yyf 
hbtmiviovie) rv-^btth. i<0J:-5KAai*<0 
fAM 5 c b izX *) &m-?)l-1-X f 4 77 

r-v a yzm^izftf&ti zbtf*imb%z. 

[004 1 3 2.2 tifflWmW?>API 

[ 0 0 4 2 3 int avs _new(char *hostname) ; Ztlli. 
*X h*(hostnane)±T«i!l$tLTV^fll««^»; 
*3V^T^T$lJ»mfi(AVobj) X5-*<«4 
Lfc*£CU3W(nill)jWg;&;fl*. iE«»TLfc«^ 
CJ4l6fTiW«*ffl(AVobj) <oi D (ISS'MfS) jWESil 
•S. Hfi^'Jffli#{i(AVobj) S tfSHHi-f <T znm 

ffW«*ffl(AVobj) <OIDZm^X?i%btl&. 
[ 0 0 4 3 3 int avs _open(int net, char *devname, 
int mode);,m{4, r X (AVdev) i*-7°y~f 

[00443 int avs _connect(int netl, int net2) ; 

uWi, 2-?o^T$ijfflim(a(AVobj) ^^>fyh • w 

■ ^^b(point-to-point)^-ri> 0 Clixfc«toT« 
«LfcHWW«u|lffl[(AVohj) <D-*jmTte»**BW 

(avs .transfer) tCj: oT^*l«(C^I» fc . t>3~ 
^H^J»#{4(AVobj) ^cOr-^^tttn^J: 

OjMft^T$i|Wffi(AVobj) H^LTlSit^gftMT*J 
Wffi(AVobj) Sr^f-SClfc^ll^to, 
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[0045] int avs transfer(int net, int dev, i 

nt length) ;£*Ui s HfrWffll*ffi(AVobj) 4>jSgfcffl 

nth . t^m x i d t lx o statr h k % mm* 

#fi(AVobj) ^-/y Lfc-f -^TOr^ xcft LT 
^fc^rS. *8 (length) CiE««*liJg1-&i:-t<Og 
§!t'»tr-^«i** { ff^i?^S (matims e c ) . £ 
.TT-fefofcfgJg-fSfc, <J:c7)MtS:(av _transfer) #4- 

[ 0 0 4 6 ] int avs _destroy(int net) ;ZtHi. ffl 
$(av _new)£J:oT^Ucll^Jlfl*ft(AVobj) £ 

[004 7] int avs _interval (int net, int dev, i 
nt interval) ;ZtHi. &jM4 ^^-^>OfS^Srff^ 
d „ »(4«im sec X'hl . tA4 XI Di LT-fe'oS- 
t&gtl>fc. ^llfiftlflW&WVobj) T^-T^Stl 

[0048] int avs resize(int net, int dev, int 

width, int height) ;ZtM. t'T^T^XCttLT 

m^mMoV3)X*-?>Zixtz^X<nt c r*ir>M 

MznLxmmztih „ 

[0049] int avs _nettype(int net, char *typ 
e);ZiHt. SlfffJWfi(AVobj) |I|;£S:f£li-f &*'y 
hy-^O^-fT^S^-f^. 3iftc7)t 1 I^,Bf|ETCP 
t U D P r- $ *UT H § . i *ltiW$C(avs_conn 

ect) zmft-ti amt,zft%fr%iitim 

[00 50] int avs _fd(int net) 754 7 

7 is 3 v<r>y r 4 Mmttmt . 
[0051] int avs _codec(int net, char *type, i 
nt quality) ;ZtHi, ;*r -f 7T-?Offi|§;fc££^g 

[00 5 2] -?-<7>ffc. r^'-f X(AVdev) {C*f Litter 

bcotfhh. mm. 

int avs _read(int net, int dev, int shmid, int si 
ze): 

int avs _write(int net, ifit dev, int shmid, int s 
ize) ; 

int avs _ioctl(int net, int dev, int request, int 
shmi ) ; 

[0053] 3 . mmwm^mcom^ 

3. 1 XV y H (Thread) cOfljffl 
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1 0 

o 1 3^f *x h ■ vmmmmK . #11/7 h 

^T/l^^SUOST^i: LXdW2m*)mz.t>tl 

[00543 {Utf . $«85fc7. U -y HfcW OSTS. 

ll#"CttHlifAttl* • «^Aaj^] • *y r-7-7&i:'<7) 
Mffi4g£X V -v H ££] THX.>M?v4V imfcth 
10 0 . f£tli* r -f 7r- ?«?>A7J BMj.4 

[0055] mmizsUTy4>zmm,x^)v* 

7°n-fe v*awrFT*^fcffljSli$r< , r- ';- 

STttif-^^ h »J -Aftfc^ U -y F fcffi 0 ST 
[0056] 3. 2 TCP/I POiUft^fiyN'-y^r 
20 frlBTCP/IP-CtiSfiffitt^HS^^to^^-y 

[0057] Lfctfo <Itl T'JiiMflfc i tf&mnfc 
ayX'lt. T7*;UNf8K (>\M h) t^oT^i. 

ynzT-ftftzt hzt izx-yxmmm.1 
mm. mmL& 1 6 o x 1 2 0 , ai§ 1 e t*>y h 

<7)B®^A,{f. -BfflT-fc«J:-?-3 8KyN'-f h fcJSrO. 
30 ftffll t SftillM^OyN* -y 7 r *-&*>4t 1 1 7 U-A fc 
>»N'-y 7 r 'J Clc7)^WiyN'>y 7 r^-f X 

***<f *kcaaM«ii*Lhi-6. mm. 

tmXOrt y 7 r J:* 4 7 A*>'ffl4 & z 
bkKtt. l®mz5yv-£.cr>xV-vxmm$:'tT0 

[0 0 58] U>U j8fcft*0X-y7rt/hS<'f* 

l>. ^WjMfl. SfiyN'-y7r<01rWX{iB5gC(setsockop 
40 t)TSECT»T*4. 

[ 0 0 5 9 ] 4 . ffi Igjaa^a^lFflli 

[ 0 0 6 0 ] 4 . 1 aMMK* 7r fcteSSJi. 

SUfcWi: LT. m-*<y h7-7(c«^it^2^<y) 

fe. iif, 7-7Xf— v-gy^T'f-^-yhTtg^ 
L; miSi&ii 160X120. 16t'-y h<7)MZ<?ME. 

so mt jPEGBMmmxm.mixm%.i. i7u-A«o 
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1 1 

1M XfSMEffi^fc X <£ 3 8 KA-f h, JPE GEffiX' 
HX^5KJU Y-bLX^Z>. 
[0061] 2*. te£S&J»t<timed(8))£fflVvC 

tett«E»» H 7 ttt J P E GEfflaffWMSWC 7 

[0062] 06 IZxit X a &SE*ST' 1 7 U-AO 

WtafcHU 7 riZ 1 10 

#A *) «IWW< ■/ 7 r <7>1M XttfttilSiBIE 
c0Mii(5i:/Ct*^*>^>'Srt^ A-y 7r-»MX#8Ky'W 

doll 6 ic J:*Ujf . f7*y^ htf«*gfln*.y 7 riM X 
#8 K>U b b £ i: A 1 ^ t> TC P/ 1 PTV>teM# 

[ 0 0 6 3 3 **lteJt*. 07K5cf J PEGEiJff 
£->fcH**IB3M-4*&fc:tt, V7h«7xr-CJPE 
GcDEfflmZft 0 yu-AU-h WMtc \\ 20 
4 . ggft; W 7 r C&7 l—^tfig t -9 T 1 1 0 £ 

if J PEG&fc'cDffifB£f^«lT-?#*>y h V- 

[00 6 4] 4. 2 BBMBJUK-F 

* -y h £Jfl^fc*£tt, <JW>*W>«a#f» fcflfc. fi 1 30 
fctt 1 6 t* -y h <7)m Om&ffiM®. tk 2 fctt J P E G 



[0065] 

[*1] 





U-Kfbs] 


rr-< \/<i [msec] 


80X60 


18.8 


90 


160X120 


8.6 


210 


320X 240 


2.2 


440 


[0066] 
[iS2] 






:r-f U"f [msec] 


80X60 


5.8 


310 


160X120 


3.4 


850 


! 320X 240 


1.0 


4500 



[0067] at, ^vbV-fblTV-fxm&r 
A V9)V^ ( I SDN:integratedservice digitial ne 
twork) ffi 1 B ( 6 4 K ) fcflft Vfc*£tf5ttttli3i3tf) 50 



#^¥7-170503 

1 2 

-*£ffi«Wr^fcfM>OBBBlMX (80X60) (C 
fcV^Ti>7l^-AU— h*<0. 2 (fps)fc^rO. H/fiW 
T&U£tf>. »S 1 6 h'v h<^SJIBft<0£)gttt&?> 



[0068] 
[*3] 



7^-A-y-^rx 


U-K1W 


7 s -c l"f[msec] 


80X60 


2.8 


750 


i 160X120 


2.0 


1050 


320X 240 


' 0.9 


2800 



[0069] zozozmmuimm&zkizi 

?7D;/5 $yX£«lttl>£i&<^::v;Hv<T 
[0070] 4. 4 XTJTfSmW)$m 

z\<mmmm.x'&mn*t*) *r <Tr-?\i.. 

tz. ^vYV—rTubuVbtXTCP/ i PSrfflv^ 

v-yixT-mmmzmmzmx'Ziitf. r—? 

<r>t&%.x'%h« 9mzco%mx'M-*-yb<7-?±.i,z 
ximittjBbwmMTj rT—rommm&n 

[0071 ] 4. 5 ast^ra^ 

-fcj&OHgTte, *>y hy-^T-oha^i: LX^U 
— t -f y/i/xfAouN i x-eaw&Tc P/ 1 P 
SrfflV^T^S. ££T% 08fc^fJ:pt, Xr-fTr 

[00723 JilT. UltcSoT. i^tTtria^^t 
BJ-fS. HltCtJWC, V>f?D*yl^t'T^^7 

3, Ai,zmt>tih. ±EA/Dag«Biiia»3tt. ^ 

fci $fc*J*tf>]BW5r*4: LTWitf G. 7 1 1 , G. 
72 1, G. 7 2 2, G. 7 2 8%b'<?>ot>0)^-f1xfr 

zm^xsm-i. ±EA/Dja»EiBiaB4'c 
it. vn&m&A/DimixT.i i??)V{c?hb& 

±^L^i 3^Bffi<?)£Effi^h LT0«i.«f J PE 
G, H. 2 6 1, MPEG*^<09%f5V^iX*»*fflV^ 

x&mth. 

[0073] ztit>im®m, Afrbom&isixtzM 
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1 3 

If F I FO**y ) 6*itlX*v h7-?i*fiS57K 
•y h%t'cr>*v hV-^8S:^T, £ft(ffltf)*-y h7- 

too74] tti. zwrnieMmmnffimzto^x. 
imztimcommtimztifcm. -?>^rv9 j f5^ io 

tf-U £^fc*-y ^-?i*ft^7*^iii:Jl$ft&J:9 
[0075] iKSfUM^)^ -y b 7-? gflSB 1 1 T'g 

fiucr-^Ji. %wm\2\,z^ximmtitz 

h^Pr-f^vyrt^V (FIFO^tU) 13£ 
i!f-^A' 7 7r^t l J (FIFWt'J) 14tCi* 

-M'y7r>t l J14ti. Zti?hMfrlliL9uy9 
»4EB17, 2 2*^co^o-yiyta-^v^Tr-^W 20 

[00 76] -*fc % y^y 7 y**yi*|£4S!l?£|I]881 5 

atm*ajL7Hi/X36»fe, m**v 1 3<of*i®«<o 

ffl£*frv\ ^-<7))iSfe*S:«*fl8IrllIK7 6^l». 

[0077] Mmm.mm»7 6xa. ±Mm%m 

miim i nzftLxtu y 9 w&smmn* ' 
mmz-mi7vv7m.®s&i 7-m. ±ie? 30 
n >y ? mmM.mmz& t x . ftpf-f^yr* 

*V 1 3<r)W.?>-&L9u>y9<KM.%.* 7 £g. {tthh* 

*y 1 3<oK»ajLaafesss) t*. 

[0078] ttt>*>. *mmmmx-\±. %pt-9 

»7r jt«U 1 3^)E(|»*<oa»**liifltt6J: :C 
LTH*. «itf» ^f-^A' 7 7r>t'J 1 3<0F*J 
< =5: 0 M fffc»£fc:l±. «*{B L ? n -y ? *K 
^a<f5J:3fc«iJ»tSit"C, 3i^f-?A' 7 40 
7r^t'Jl 3«>rtg*&^$r< U i££X.y7r** 
'J 1 3 ^fi«^^5rt Ji. K»[BL^ny 

s. 

[00 7 9] ZZX\ t^f-^ffl(OiE'<77r^ ; E 
'J rt3*«!l5S[I]8& 1 5 &tffltttPJ6rlilK 7 6 tfcWC 
®9£^«fc3&7n-f-*-M;:J:-jT s #;&t 50 



4/12/06, EAST 



8HPP7-1 70 503 

14 

[0 0 80] ^C0H9tCfc^T, ^f77S lt'fcL § 
jS-f-^y^r^y 1 30rtS»<7)Sll^ilS (# 
(4«iB4^H) ±fEffll£ffiStiJilTO 

S= { (A.y7rgi*ajL7FWX) - (yN'-y7rS§ 
E^r HL-X) * 71^-AJflK} / ( 1 71^-AC7)T- 
**) 

[0 081 3 <X<7)AtvTS2X'U. =Ml5t«Si# 
^T-^W^r^y 1 3CDfi®%cr>m]E&mcO±. 
ilSmaxtKS>Smax!:|iJ$l, /-fcWJg 
L£^£l;W-f •y7 , S2 2fcjt^ j£fc-f xxfcfljg 
Ut^fcteXT-yTS 2 1 fciltf. 

[0082] ±faxr 77-S 2 1 Tli. %Pt-?M* 
77r^tU l 3^*ftL7ov?^jg&&£P*f(f 

[0 083] ttz. JilE^T'yTS2-cy-t¥iJ|ff$ii 
X X T -y y S 2 2 fcjt tf k , CI cOXf- -y 7° S 2 2 T'ti » 

±lES95tffi s t w^r- 9 <r» •? -y 7 r p< ^ y 1 3 cortg 

M^OjSiEKHomffl Smini:*>feS<SminSrW 
Jtt*. iKXr-yTS2 2T\ y-fcflJgUfc«^t: 
-y T S 1 izm 9 , A t WW Lfe^tctt^r 
■y7S2 3fc«tf. 

[0 0 84] Xr-y7S2 3-C'(i. &P¥-fW*>y7 
t. Cl(7)i:§<y)P«0<lt, 0"U(fl%i:tS. IWXf 

«y 7" S 2 3 COftfiXx y 7" S 1 fc^S . 

[0085] <irfc. : t^f r -^^^"-y7r^^ , J 1 3tO 
rtW»<0»iEeH^)iiiEil2: Sstafct^t, ±|E± 
RffiSmaxkJJStiEfiSs tatTffilSmi nt 
<7)Mf^{iSmi n<Ssta<Smax!:W„ 

[0086]-^. rtv7TX*V\*mMM%.m2 0 
(i. WfllT-^A'.y7r^ ; e , J 1 4<o##a^7Hi^^ 

at>majL7h-^x*^a^ ; E , j 1 4tf)rt*ji<^i 
[oo87] mmmmms 1 -ca. iiESH^ass 

2 0 frfetfM t U 1 4 <0^SMI]ttift(=S^V . ± 
lE^^y 1 4<r>^tHl9xi'y9im.-tim^liiL9 
d -y 9 5&fc@S& 2 2 |C*f LX 9 V -y ^ffliHRlKE^S' 
SKH»ajL^nv^«4HIB2 2Tli. ±IE^ 
o -y 9ffim.feim^Zfc tX , %Pt-9'<v7t* 
*y 1 4<DB*iBL*Dy?<3a«£2©g (t**)^ 
*U 1 4«I«»ajUjWE*30!) t*. 

[0088] t**>^, «<atffwircii, wk?-* 
9>mt:ms.-f&mmno ztx\ mmm?-** 

•y 7 r ^< * y 1 4 OiE<S^*<0M»»*SP«tS J 3 
LTV^. Wttf. «ffif-^A'77ry( ; E l J 14«0|*l 
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• 1 5 

zxK-tiioiztmtizt-e. grata?-?'*? 
y ^w^SA^^-^^-wi, m^tat^a-y 

^'J 140l*l£*££<-t.|>„ iOi 3 

iSh^t-^a'7 7 r^^t y 1 4t*i»t*Aaa»&ffi 
s. 

[0089] ^T-^ffltfOiiE'^r.** 

y rt*«Kiii»2 0Mfti3t«fM7 1 feasor 
a, 01 o^-rj:o^7P-^-v-htj;o-c. mm 

r-*A,7-r**y 140rtS*£HJgU ±iE^* 

COO 9 0] £0111 OfcfcWC. Xf7 7"S1 1 T* 
tt. lMRf-^0-''<<y7r^*y 140rtS*0«3eil 
v (*ffifc£ft&fflg) ±!£S!lSfflV(i 

V= { (A'-y7rSg^ttJLTH^) - (A 7 7rtl 
>&&7 h* ) * 7 U-Ajg »i } / ( 1 7 U-AODf- 
?*) 

[0091] ^Xf'y7S 1 2-Cli. ittffigttVi: 
HMRf - W 7 7r^'J14 iOrt^SO jSIEKH^ 
±KffiVmaxfc*>£>V>Vmax£fl5£U /-ifl 

5tU:*£fcU;Uf-yTS3 lfcBtf. 

[0092] UE*T 77" S 3 1 Ttt, »if-?«^ 
77r^'J 14a^ttL?n9?*>jnflk*P£ft 
$r*s, £*>P*)«i. (rU(f l%fc-f£. 

[00 9 3] 4fc, ±ieXr"-y7S12TV-i:|iJ|fffS 
*lTXxyrS3 2{CjtOfc. ^Xf--y7*S3 2-C 
it . ±Kil^ffl V fc - ? ?V n* -y 7 T .* * 'J 1 4 
rt^40jiiEiEH^TIHiVm inkHV<Vmin 
SrWg-fS. ^X-f yrS3 2T\ ^-tW^Lfc* 
^fciiXr-yrsiltMO, -fxxiWfrLtti^C 
ttXr«yrS3 3tjttf. 

[0094] Xx-y7S3 3T'{i, Mf-^<7)A' 7 7 

•y7 , S3 3^i7.ry7*S 1 lfcMS. 

[00 9 5] &i>» ^«T-^c7)^'-y7r^^y 1 Aco 

m&nwsHmnmiEm v s t a t-r s t , ±ia± 

RtVma x i: JilEMIEttV s t a fcTRSttVm i n fc 
OM^IiVm i n<Vsta<Vmaxi^. 

[0096] ±m<dx o iz ixmfr&immw mzti 

.XtU 1 4*^^iil$iX7t#^T-^i:BUI[^T-^ 

$SD/A3d$SEIBl8, 19fc3S6*i4. i*i4>#5SD 
/A£SM3»i 8. 1 9?it. m&A/D$£ffl£mm& 
3, 4T'^#ffi^«ia^*fJC1-S#3g»l^A { '?-^'fiX)lfi 
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[0097] ±ia««D/Asamii» 1 s^^^ft 

9*»£*>I?MMI# «it-^r 4 X7*M 2 4 £i*£>ft 

[ 0 0 9 8 ] 4fc % ±ia4HBH» 1 2 fcttfcSfufcWi 
fl^«±. SK»«l3B12t^LTI9Slftajia»2-5t: 

tiM^ixi... ^M«?ajniss2 5T'{i, ±Mi%mm^frt> 

10 hr-^ra^AT-?, W6rr-9, 9SP»U-f- 

[0099] z<7)mmm^2 siz&^xim^p^wm 
m^m<T-?zmftt&b. %muam2 5*» 

m^mtezti&t. m%mm*H)*t>%muiimiz 

[0100] iK-r-^J0aHI8S2 6TJi. flMSSftrt: 
7J-T4. fcfc, JJBBMeoWIi: LTf±, fliifttOIT 
[0101] .I<7)i: 3 fc. aHt*«03M«fc:*JV^ 

±B»aiiii»2 5**L. ±e^w§iiii2«<in 

.WW*HK £i:(cJ:o"C, 

[ 0 1 0 2 ] ifc, #llJitfiJ<Og«§slK?)#8ilIIB l 2 
B2 5£i££>;fl£. 

[0103] ^^t#£7)±|e^iill£li?S2 5Ttt, 

wm<m>k<n x o fcttcM&flrMHteaiart-* . 

40 r- ^fflO _hie«»*"JffiTlHlB 6 7 i: 8 1 fc*f LT , 

[0 1 04 ] ±fe^r-^ffl^±IE^*WllrIlIB7.6 
p?-frt y y r X*V 1 3tt>V^TiJE^aifi-ftM 

ie#^r-^N'-y7r^^y 1 3 ittgwra 1 
?fT-^o#5RD/ASai0Bl 8tca^iii J: dtaw 

50 *fLTti» /N'-y7r^^y 1 30rt§*WJi(f frlLh 
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C0105] z<?>£ otztxh. *mm<n%mmx' 

SidtS:*. 

^^tcov^{i±E^«T-^A'.y 7 r.** U 1 4 

y 7 r ^ * U 1 4 <Oi*H£Jfc>ajEEfc£04 it* 5 
[0107] iftfc J: 0 s 3^3fc«<oS^arc{4, ± 

jEMfcEMcs** it _hi»«tf>ss 

7*M 24£**3*l*ttfltyi. MflKSftoifc*^ 

[0108] a*:. *»HH^fS<o^ff|<o«Bg^0 i i 

[0 109] lfcfcwc, ilffiffll^xbnye 

a-^Wi, t^fU7 , M4 0t?>f?n*y4 
lkt-5 t 3r^94 2]WM*S*l, *fc*»h7-?4 

[0 1 103 3ltaHIH**h3>eA-*fc*iVvC. 
CPU3 0J4. ^c>fyy%U31(=ffi4r^TV)«7D 

mnZfio. >SriJ, .IOCPU3 0(i. 01 Or-?® 

aniss 9Akvx ommz t w-r * . 

[0111] t'fW54 2*^cOB*ffift^<4, A/ 
D3E8U£HU!]aa 3 8fc J: o T A/DWiS*i6 kKK 

7r.* ; e!J3 4C-is|#i.£>iil>. -7-f^o*y 
4 1 *»&<0tf J*fi*H\ A/D£8UE*gjMS3 7 fcj: 

Ml*. 

[0 112] 7W- i».**y 3 2fcUi, WitfC 
PU3 0fcj:->T»«3<ifc««7l'-AT-^. t* 

l^-Af-^*1B«SW. S&7U— A^*U3 2*> 

X3 6£^LT*-*r>rXTW4 0Ki*&;h.T^ 



18 



[0 113] 3S,(C, ±E/<<y7r^«y3 3. 34t 
«f C P U3 0lz£-iX-?!W-7U?X%tlfi:&lZJ<'v 7 

A77t«'J 3 5*»^>l^aj§*UtT-^«. 
7-?^y?7x-X3 9«§W;*7t-7-?4 

[0 1 143 5Wltt*xb3ytA-^fcJi, * 
10 ^;?t 4X7*1^ 6 1 txt-#62#g$§$ft, S4> 
lz* yh7-7 4 3£-frLXmmM*Xhti 

kmmtiz. 

[01153 SB3e««*xh3vea-^tfev^"r. 

CPU 5 2(4. ^y^'J 5 3K&ft3*lT^*Tn 

S»*ff3. ifc. Cl^CPU5 2(i, MBA*7rrt 
«WgEI»15. 2 0^?lSflBfHlSS7 6, 81&tf 
m*-ftl?a-y7%&.mi7, 22kLXcOfflfcZi> 
UfctfoT. fflEiai<0^ , y7r^ : & , Jrt§*O 

[0 1163 ±E**H7-7 43 &ftlX±§SMm 

7-^'(y^7x-X50^UA77r^ty 5 1 

[0 1173 i^N'.y7r^ J tli 5 1 36»6K*{BSiifc 
Sftr-^*>fe{is HifcJfc pu 5 2tcioT±iaEffl 

ttJfrf S^-y 7 r^^'J 54, 5 5fc&£>*t*. 
[0 1 183 A* * 7 T^t'J 54 (cafetlfcffiMdilft 
30 WRr-^tt, SiA' 7 7T^t'J 5 4*»fefE»fflSit 

xr-?wmmu5 uz&hixx±mmm*xya 
>v*-?x°(Djmizttmm i mmmzh&. g 

BMWIS^ifcWrtR^-^tt, 7P-A^t'JfcIi(bfi 

fctfl/Ct-^T* 6 1 fc»MrC**S*i 

*. 

[0 1193 A?7 T **y 55fciS4>;fifcff« 
r-^#3iS!ia^ 5 9 tea WvCJJEaHI«#x bay 

40 v*-9x*<nEmizttmm^>tmmzti& . 

*KR3*ifc*J»7*-*tt. D/A^msaagp 6 0 1 J: -? 

[01 203 ±ML^ J: *^<0#jliS^S{c 

T-^coSfi^iiS^fc^ll (A V 7rWrt«*<0jB 
€<1S, V) ISl^rt (A'-y7rcOF ( =l^Mcoa 
iEKH^±|®fflSmax, Vmax) ZMttlZk. X 
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<lSm in, Vmi n) ZTH^tzZ b *®.\bth b . 

(rt-yyr<r)fy®M.cr)ffijEmWcr>±MMSmax., Vm 
ax) fc^2^B#Hrt (TRSilSm in, Vm i n ) b 

mmm'noko\,zi,x^h<?>T\ A^r^ty i 

3, 14^ 7 7t> ; E i J54, 5 5<7)A^I*^di*^ 
T'?)l$ISIjI*l£B&jIiEtt (Ssta, Vsta) £@f! 

fc^tli, A 7 7t«!J 13, 14, 54, 5 5WA 

^*^ai^^-c^raiiixj^< l. atfj-mxr-f 10 

[ 0 1 2 1 ] «atW<0«iKBK*jV^tt, r 
-*IMiGIB2 5*RW\ i<Or-^aj0SS2 5KJ: 

UtaiLfci:*fc:li, f-^«iaill»2 6t:tjv^r*<04 

ijra-rs i a t Lfci t x\ »ro* minima 

hZbZffi^Wh. 

[ 0 1 2 2 ] $ fcfc, *Wt«*OJ«KfiaK*JV^tt. 
fttfSI3IB2 6KJ:oT*fi«*&»4>#J*, JfttRtefcWC 20 
»K«W0r«»t «W1 Lit fc * fctt. flWWBflllK 7 

*U 1 3&yi 4tf5A**»felll**-COi«BSh.*aDE 

ovarii*?)* ifta-riikT. i<oawKo«^fco 

vvctt«*3*i* Z b fcBftv 
[0 123] 

[WJfcOSWRJ JJ*a«k3£:W^coSfia»C*JVvt 30 
tt. ftJfflWi, 5e««*0H4ii*IBi:3MM.tei*iafc 
a£#mw*Hrt*)R;ifc£i:. XJi£2c7)B#fS!f*]£ 

®b%m2timfflb<7)m$:micDmmftbm2cr)mm 
«A*^<9aj**-c^«HBBWi*aDE*fc:iiias*ii 
firaaaiej: -5 x gmmx-OT-fmrntfrntix , A*. y 
•cteiiW(c«Ha®h.s:isia-r4it*<nr«gi:^5. * 40 

xi>, mmzztizm&i-hzbffX'Zt. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2 **** s h ows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] In the receiving set of the real time which makes the difference of the time amount to 
reproduce and the received time amount less than predetermined time, and reproduces the signal of 
voice and/or an animation An incorporation means to incorporate a signal, and a playback means to 
reproduce the signal of voice and/or an animation, The 1st detection means which detects that the 
difference of voice and/or the playback time amount of the signal of an animation, and the received time 
amount is in the 1st [ as an upper limit ] time amount, The 2nd detection means which detects that the 
difference of voice and/or the playback time amount of the signal of an animation, and the received time 
amount is in the 2nd [ as a minimum ] time amount, The receiving set which adjusts the read-out rate 
from a buffer means to buffer a signal, and the above-mentioned buffer means, and is characterized by 
having the control means which performs control which constitutes the difference of the above- 
mentioned playback time amount and the received time amount in the 1st time amount of the above, and 
the 2nd time amount. 

[Claim 2] The receiving set according to claim 1 characterized by processing as it is when the detection 
means of the above 3rd receives the signal except the above-mentioned voice and/or an animation, while 
an input signal establishes the 3rd detection means which detects that it is a signal except voice and/or 
an animation and also receives the signal except voice and/or an animation. 

[Claim 3] It is the receiving set according to claim 1 or 2 characterized by processing the predetermined 
part concerned as it is, and discarding about other parts when the 4th detection means which detects a 
predetermined part from an input signal is established and the detection means of the above 4th detects 
the above-mentioned predetermined part. 



[Translation done.] 
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♦NOTICES* 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the receiving set which can respond to multimedia data 
like an audio or a video , data especially about the receiving set used by the technical field of a 
communication link like a computer network. 
[0002] 

[Description of the Prior Art] in recent years, the engine performance of a personal computer, a 
workstation, etc. is boiled markedly, and improves, and is spreading close. Moreover, demand of 
wanting to use them for everyday communication like television or a telephone recently, and demand of 
wanting to utilize these information processing system for a wide range application are coming out. 
Therefore, in the above-mentioned personal computer, the workstation, etc., in order to realize these 
demands, it is necessary to enable it to treat multimedia data, such as voice and an animation, 
interactively on a distributed environment. 

[0003] Here, as information processing communication system used by the communication link of the 
•conventional multimedia, the thing of a configuration of being shown in drawing 12 is known. 
[0004] In this drawing 12 , voice data, a video data, etc. are supplied from an input device 100 or 101. 
As this input device 100,101, the A/D converter which changes the sound signal of the analog from a 
microphone and the video signal of the analog from a video camera into a digital signal, for example can 
be mentioned. The data from this input device 100,101 are sent to the input data processor 102,103, 
respectively, and predetermined data processing is performed, respectively. As data processing in this 
input data processor 102,103, data compression processing can be mentioned, for example. After 
multiplexer processing is carried out by the multiplexer 104 and the compressed data from the above- 
mentioned input data processor 102,103 is stored in the transmitting buffer memory 105, it is read, and it 
is sent to the network receive section 1 1 1 of a receiving side through networks, such as Ethernet, from 
the network transmitting section 106. - 

[0005] Once the data received in the above-mentioned network receive section 1 1 1 are stored in the 
receiving buffer memory 1 12, they are read, and further, by the decollator 1 13, the separation processing 
corresponding to multiplexer processing of the above-mentioned transmitting side is made, and they are 
sent to the output-data processor 1 14,1 15. The output-data processor 1 14,1 15 concerned performs data 
elongation processing corresponding to the above-mentioned input data processor 102,103, and sends it 
to a regenerative apparatus 1 16,1 17 after that. In addition, a D/A converter can be mentioned as an 
example as the regenerative apparatus 1 16,1 17 concerned. 
[0006] 

[Problem(s) to be Solved by the Invention] By the way, there are the following troubles in the 
conventional information processing communication system mentioned above. 
[0007] First, in the above-mentioned conventional information processing communication system, the 
processing of contents may come to increase too much in delay and the receiving buffer memory 112, 
for example by fluctuation of loads, such as the above-mentioned output-data processor 1 14, 1 1 5 of a 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



4/12/06 



JP,07-170503,A [DETAILED DESCRIPTION] 



Page 2 of 13 



receiving side. Thus, if the contents of the receiving buffer memory 1 12 come to increase too much, the 
time lag from the entry of data in the receiving buffer memory 112 concerned to an output will become 
large. 

[0008] Moreover, in the example of drawing 12 , although receiving buffer memory serves as an unit, if 
the difference of inner capacity comes to become large too much among two or more of these receiving 
buffer memory when there is two or more receiving buffer memory, although the receiving buffer 
memory of these plurality must synchronize essentially, the time lag between the buffer memory in the 
case of an output (namely, time lag between media) will become large. 

[0009] It explains more concretely about this conventional fault. For example, multimedia data, such as 
an animation and voice, have an essentially different property from numeric data and text data which the 
computer has so far processed. Multimedia data essentially have [ multimedia data ] the amount of data 
immense and redundant [ namely, ] to not a mere sequence of bytes but having the attribute of time 
amount clearly or suggestively, and the second in the first place. Even if the throughput of hardware 
improves, in order to treat efficiently ^ interactive processing is needed that it is necessary to carry out a 
data compression and the third, and it has properties, like engine performance, such as not only a 
throughput but a response and delay, is thought as important. 

[0010] For this reason, in order to treat these by the distributed environment, it is necessary to introduce 
new technique into the synchronization between media, a communication link, processing, RISOSU 
management, etc. 

[001 1] Then, this invention is made in view of the above actual condition, there are few time lags from 
an input to an output, and the time lag between the media in an output is also aimed at offering a small 
receiving set. 
[0012] 

[Means for Solving the Problem] In the receiving set of the real time which the receiving set of this 
"invention is proposed in order to attain the purpose mentioned above, and makes the difference of the 
time amount to reproduce and the received time amount less than predetermined time, and reproduces 
the signal of voice and/or an animation An incorporation means to incorporate a signal, and a playback 
means to reproduce voice and/or an animation, The 1st detection means which detects that the difference 
of voice and/or the playback time amount of the signal of an animation, and the received time amount is 
in the 1st [ as an upper limit ] time amount, The 2nd detection means which detects that the difference of 
voice and/or the playback time amount of the signal of an animation, and the received time amount is in 
the 2nd [ as a minimum ] time amount, It is characterized by having the control means which performs 
control which constitutes the difference of the above-mentioned playback time amount and the received 
time amount in the 1st time amount of the above, and the 2nd time amount by adjusting the read-out rate 
from a buffer means to buffer a signal, and the above-mentioned buffer means. 
[0013] Moreover, the receiving set of this invention is processed as it is, when the detection means of 
the above 3rd receives the signal except the above-mentioned voice and/or an animation, while an input 
signal is equipped also with the 3rd detection means which detects that it is a signal except voice and/or 
an animation and also receives the signal except voice and/or an animation. 

[0014] Furthermore, when it also has the 4th detection means which detects a predetermined part from 
an input signal and the detection means of the above 4th detects the above-mentioned predetermined 
part, the receiving set of this invention processes the predetermined part concerned as it is, and discards 
it about other parts. 
[0015] 

[Function] According to this invention, if it is detected that the control means crossed the inside of the 
1st time amount whose difference of the playback time amount of the signal to reproduce and the 
received time amount is an upper limit, or that it was less than the inside of the 2nd time amount which 
is a minimum, the read-out rate from a buffer means will be adjusted, and control which constitutes the 
difference of playback time amount and the received time amount in the 1st time amount and the 2nd 
time amount is performed. Namely, since the storage capacity within a buffer means will decrease too 
much if less [ if the difference of playback time amount and the received time amount exceeds the 1st 
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time amount, the time lag from the input in a buffer means to an output will become large, and ] than the 
2nd time amount When the difference of playback time amount and the received time amount crosses 
the inside of the 1st time amount or is less than the inside of the 2nd time amount While making a 
proper value recover the time lag from the input of a buffer means to an output, he is trying to prevent 
the storage capacity of a buffer means decreasing too much by carrying out the difference into the 1st 
time amount and the 2nd time amount (upper limit) (minimum). 

[0016] Moreover, by processing as it is, when according to the receiving set of this invention the 3rd 
detection means is established further and an input signal detects that it is a signal except voice and/or an 
animation with this 3rd detection means, when input signals are text data, program data, numeric data, 
other binary data, etc., it has prevented the contents of these data changing. 

[0017] furthermore, when according to the receiving set of this invention the 4th detection means is 
established further and this 4th detection means detects the predetermined part of an input signal It is 
made not to cancel about the signal of this predetermined part by making it make a proper value recover 
the time lag from the input of a buffer means to an output, and processing that predetermined part as it is 
by canceling other parts except that predetermined part. 
[0018] 

[Example] Hereafter, with reference to a drawing, the example of this invention is explained in full 
detail. 

[0019] The configuration of the receiving set of this invention example is shown in drawing 1 . As the 
receiving set of this example is shown in drawing 1 , the signal of voice and an animation The network 
receive section 1 1 and the separation circuit 12 as an incorporation means which are the receiving set of 
the real time reproduced so that the difference of the time amount reproduced and the time amount 
received may become less than predetermined time, and incorporate a signal, The voice data buffer 
memory 13 and image data buffer memory 14 as a buffer means which buffer the voice and the video 
data which were separated, It comes to have the voice data elongation A/D-conversion circuit 18 as a 
playback means and the image data elongation A/D-conversion circuit 19 which reproduce voice and a 
video data. 

[0020] Furthermore, the 1st detection means which detects that the difference of the playback time 
amount of the signal reproduced about voice and an animation and the time amount received is in the 1st 
[ of an upper limit (Smax, Vmax which are mentioned later) ] time amount to the receiving set of this 
invention example, And the buffer memory inner capacity measuring circuits 15 and 20 as 2nd detection 
means which detects that the difference of voice, the playback time amount of the signal reproduced 
about an animation, and the time amount received is in the 2nd [ of a minimum (Smin, Vmin which are 
mentioned later) ] time amount, If it detects that it was less than that the difference of the above- 
mentioned playback time amount and time of delivery exceeded the above-mentioned upper limit with 
the detection output from the buffer memory inner capacity measuring circuits 15 and 20, or a minimum 
Based on the detection output concerned, it has the operation decision circuits 76 and 81 which perform 
control which constitutes the difference of the above-mentioned playback time amount and the time 
amount received in the time amount of the above 1st, and the 2nd time amount (upper limit) (minimum). 
The above-mentioned control is performed because the above-mentioned operation decision circuits 76 
and 81 control the read-out clock generation circuits 17 and 22 which generate the read-out clock of 
each buffer memory 13 and 14 and specifically gather or lower the read-out clock rate of each buffer 
memory 13 and 14. 

[0021] Moreover, the receiving set of this invention example has formed further the detector 25 as 3rd 
detection means which detects that it is ability ready for receiving also about voice and the signal except 
the signal of an animation, therefore input signals are voice and a signal except the signal of an 
animation. When an input signal detects that they are voice and a signal except the signal of an 
animation, the receiving set of this example makes only voice and the part except the signal of an 
animation separate in the separation circuit 12 according to the detection output from the detector 25 
concerned, and he is trying to process it as it is by the data-processing circuit 26 about the separated part 
concerned. In addition, as a signal except the above-mentioned voice and an animation, text data, 
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program data, numeric data, other binary data, etc. can be mentioned, for example. 
[0022] Furthermore, the above-mentioned detector 25 of the receiving set of this invention example 
operates also as 4th detection means which detects the important parts of an image or voice as a 
predetermined part from an input signal, and sends the detection output from the detector 25 as the 4th 
detection means concerned to the above-mentioned operation decision circuits 76 and 81 . In the 
operation decision circuits 76 and 81 concerned, to the corresponding voice data buffer memory 13 and 
the corresponding image data buffer memory 14, the above-mentioned predetermined part is processed 
as it is, and read-out control which discards other parts is performed. 

[0023] The basic function of the information processor corresponding to multimedia data of the 
information processing communication system with which the receiving set of this invention is first 
applied in advance of explanation here concretely [ the receiving set of this invention example shown in 
drawing 1 , drawing 9 - drawing 1 1 ], the model of this information processor, and the so-called 
application programming interface (API:applicationprogramming interface) Below, it divides into an 
item and positioning of the information processor concerned corresponding to multimedia in 
information processing communication system and evaluation of the information processing concerned 
are explained. 

[0024] 1. **** of Information Processor corresponding to Multimedia in Information Processing 
Communication System - Target Which this Information Processor Realizes « (1) Although There is 
Various Constraint Building in a standard personal computer and a standard workstation, and 
maintaining compatibility with the existing system, and (2) A communication link and characteristic 
processing of voice and an animation He leaves it to the information processor concerned, and a client 
program performs only the control, (3) That it can be flexibly coped with according to the attribute of 
media data, and the purpose of a client program, and (4) That it can respond to fluctuation of the load of 
resources, such as a processor and a network, and (5) It is that a model is simple etc. 
[0025] From these demands, it is necessary for an information processor to have the function which is 
described beiow. 

[0026] 1.1 As media data treated with a media type information processor, there are voice and an 
animation fundamentally. Time attributes, such as the amount of data per unit time amount and 
generation time of day, are given to these, and this is used for processing with an information processor. 
For example, in the case of voice data with a data width of face [ of 8 bits ], and a sampling frequency of 
8kHz, the attribute of [ time amount / unit ] 1 byte in the amount of data per 1/8000 (sec) and unit time 
amount is given. 

[0027] 1.2 An information processor and a media device information processor output the data from two 
or more input devices to an output device, taking a time synchronization. 

[0028] As an input device, it is (1). Hardware devices, such as an audio interface and a video input 
interface, and (2) A multimedia data file like a sound file, an animation file, or a movie file, and (3) A 
multicast address and (4) A client process etc. is supported. 

[0029] As an output device, it is (1). Devices, such as an audio interface and a window, and (2) A 

multimedia file and (3) A multicast address and (4) A client process etc. is supported. 

[0030] The device which only only one information processor exists in a certain host, and it deals with 

directly needs to be on the host. When an input device and an output device need for a separate host to 

have, a client accesses each information processor on each host, and connects an information-processor 

comrade. 

[0031] 1.3 The following can be considered as an evaluation standard of the quality of the object with 
which a user is provided as a media data transfer and a synchronous multi-media system. For example, 
(1) The tolerance limit of the delay of a transfer, and (2) A tolerance limit synchronous [ between 
media ], and (3) A throughput and (4) It is the case where it is not allowed with the case where the 
deficit of data is allowed. 

[0032] In order to acquire the quality can be satisfied with the given transfer way of quality, various 
parameters in the case of a transfer, such as the amount of data, a compression method, a protocol, and a 
packet size, are controlled. An information processor performs the synchronization between media in 
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accordance with the valuation basis of quality. 

[0033] 1.4 The network protocol of the multimedia data which the network-protocol above-mentioned 
information processor uses controls a flow etc. dynamically, taking the valuation basis of quality into 
consideration. IEEE of the present network environment Since network devices, such as the so-called 
Ethernet (Ethernet) based on 802.3 specification and a fiber DISUTORIIBYUTEDDO data interface 
(FDDLfiber-distributed data interface) of 100 M bit-per-second token passing access using the optical 
fiber proposed in SCI 3 of International Organization for Standardization (ISO), are scrambling for and 
sharing the resource separately, on a distributed environment, service which secures a network resource 
beforehand is difficult for them. However, considering compatibility with the present network 
environment, it is the Internet protocol (IP:internet protocol). It is necessary to use and is the so-called 
transmission control protocol (TCP transmission control protocol) as network protocol this time. The so- 
called user datagram protocol (UDP:user datdgram protocol) which is a protocol of a connectionless 
format was used. 

[0034] 1.5 The compression elongation information processor of data has the compression elongation 
function of voice data or a video data by software or hardware. As an audio compression method, 
specification, such as the advice G.71 1 of the voice coding standard of the KOKUSAI DENSHIN 
DENWA communication link advisory committee (CCITT), G.721, G.722, and G.728, is supported. 
Moreover, as a compression method of an image, there are methods, such as the so-called JPEG (Joint 
Picture Expert Group) of the international-standards-ized WG of the color static-image coding method 
of the KOKUSAI DENSHIN DENWA communication link advisory committee (CCITT) and MPEG 
(Moving Picture Expert Group) of the international-standards-ized WG of image coding advice H.261 
for video conference systems and a color dynamic-image coding method. Since it is characteristic for 
every compression method, it is necessary to use properly by the application. 

[0035] 1.6 The control information processor of a resource has the fixnction to process the input/output 
request from two or more client programs. For example, a voice input device can consider the following 
arts, when that there is only one has a voice input demand from two or more clients. 

(1) Copy and distribute to all demand origin. 

(2) Give priority to the demand of first arrival and refuse the demand worn the back. 

(3) Change a client one by one. The program of the multimedia manager equivalent to the window 
manager in a windowing system etc. uses this function. 

[0036] 1.7 In treating multimedia data, such as control voice of a physical device, and an animation, it is 
necessary to connect the so-called audio-visual device (AV equipment) like a video camera or a 
videocassette recorder. An information processor supports the predetermined protocol for AV equipment 
control for these control. 

[0037] 2. Model and API2.1 of information processor The model information processor of the 
information processor to which an AV equipment is connected generates one execution control unit 
(AVobj) to each client, as shown in drawing 2 . When a client wants to output and input multimedia 
data, a demand is advanced to an information processor by the following procedures. First, it sets per 
execution control (AVobj) and is an imagination media device (AVdev). It opens. The imagination 
media device concerned (AVdev) Since it is not a physical device, exclusive control, opening from 
plurality, etc. are realizable. 

[0038] moreover, it is shown in drawing 3 - as - the object for an input - the above - imagination 
media device (AVdev) Opened execution control unit (AVobj) the object for an output - media device 
(AVdev) Opened execution control unit (AVobj) A multimedia data transfer way is secured by 
connecting. The same execution control unit (AVobj) The synchronization of the media between the 
devices opened is guaranteed. 

[0039] Furthermore, it sets to the information processor on a different host connected like drawing 4 in 
the network, and is an execution control unit (AVobj). In the workstation on a distributed environment, a 
multimedia data transfer is performed by generating and connecting. 

[0040] Transmission and execution control unit of a receiving side (AVobj) Device to open (AVdev) A 
telephone is realizable, if it carries out and a sound device is used. Furthermore, a TV phone is realizable 
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if a video device is opened. Moreover, it is a movie (Movie) as an input device. It is a movie (Movie), if 
a file is specified and a sound device and a video device are opened in an output device. It becomes a 
player. Thus, it becomes possible by rearranging the device of I/O to create various multimedia 
applications easily. 

[0041] 2.2 The following are prepared for the library of the API information processor of an information 
processor. 

[0042] int avs_new (char *hostname); it sets to the information processor started on the host name 
(hostname), and this is an execution control unit (AVobj). It generates. Null (null) is returned when an 
error occurs. When it terminates normally, it is an execution control unit (AVobj). ID (identification 
information) is returned. Execution control unit (AVobj) All instructions to receive are this execution 
control unit (AVobj). It is carried out using ID. 

[0043] int avs_open (int net, char *devname, int mode); this is a device (AVdev). It opens. An argument 
is an execution control unit (AVobj). They are ID, a device name, and the mode. 
[0044] int avs_connect (int netl, int net2); this is two execution control units (AVobj). Point-to-point 
(point-to-point) connection is made. Execution control unit connected by this (AVobj) Function which 
one side describes below (avs_transfer) If it will be in a transfer condition, it is another execution control 
unit (AVobj). The data which can receive the data now and were received automatically are processed. 
One transmitting execution control unit (AVobj) It receives and they are two or more receiving 
execution control units (AVobj). Since connecting is possible, the data transfer of one-pair ** can be 
processed. 

[0045] int avs__transfer (int net, int dev, int length); this is an execution control unit (AVobj). 
Transmission is controlled. If O.is specified as a device ID, it is an execution control unit (AVobj). It 
becomes effective to all the opened devices. If a positive number is specified as die length (length), data 
transfer will be performed only for the die length (a unit is msec). If zero are specified here, it is the 
following function (avjransfer). It transmits until it is given. If a negative number is specified, it will 
stop immediately. 

[0046] int avs_destroy (int net); this is the execution control unit (AVobj) generated with the function 
(av_new). It releases. 

[0047] int avs_interval (int net, int dev, int interval); this sets up a transfer interval. A unit is msec. If 
zero are set up as a device ID, it is the execution control unit (AVobj). It is adapted to all the opened 
devices. 

[0048] int avs_resize (int net, int dev, int width, int height); this requires size change from a video 
device. The unit of size is a pixel. When zero are set up as a device ID, it is adapted to all the video 
devices opened in the execution control unit (AVobj). 

[0049] int avs_nettype (int net, char *type); this is an execution control unit (AVobj). The network type 
which connects a comrade is set up. Now, said TCP and UDP are supported. Before this performs a 
function (avs_connect), it must be performed. 

[0050] int avs_fd (int net); this is a client and an execution control unit (AVobj). A control connection 
connection's file descriptor is returned. 

[0051] int avs_codec (int net, char *type, int quality); this specifies the compression method of media 

data. Here, only compression elongation of said JPEG is supported to image data. 

[0052] In addition, device (AVdev) There are the following as a library for receiving and accessing 

direct media data. For example, it is int avs_read(int net, int dev, int shmid, int size);int avs_write(int 

net, int dev, int shmid, int size);int avs_ioctl(int net, int dev, int request, int shmi);. 

[0053] 3. Positioning of the information processor in the whole mounting system of an information 

processor becomes like following drawing 5 R> 5. 

3.1 If the use thread of a thread (Thread) is used, the time amount of context switching is short rather 
than it realizes using two or more processes, environments, such as memory, can be shared between 
each thread, and programming will become easy. In realizing an information processor, the following 
two kinds can be considered as the approach to the model of a thread to assign. 

[0054] For example, ****** which assigns a thread for every data stream assigned to a thread for every 
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function. In the former, it is the approach of assigning a thread for every functions, such as screen I/O, a 
voice input/output, and a network, and forming a pipeline, and the latter is the approach of assigning at a 
thread the processing which performs from the input for every media data to an output. 
[0055] Since the latter was suitable in order for there to be no advantage and to perform schedule 
priority control of a stream unit in two or more streams, if it is not under a multiprocessor environment 
even if it forms a pipeline for every function, in this mounting, the approach of assigning a thread for 
every data stream was also used. 

. [0056] 3.2 In the transmitting receive buffer of TCP/IP, and the delay aforementioned TCP/IP, in order 
to realize high-reliability, perform sequencing of a packet, a checksum, a time-out, and a re-transfer, and 
data transfer delay poses [ an overhead ] a problem large. 

[0057] Therefore, the buffer is prepared here for transmission and reception. For example, by 
workstation, it is 8K (cutting tool) by the default. When this buffer is covered with data, delay arises. 
For example, if resolution is 160x120 and a screen with a depth of 16 bits, it becomes about 38 K bytes 
on one screen, and one frame is not buffered, either, even if it sets the buffer of both a transmitting side 
and a receiving side. In this case, if buffer size is enlarged, transfer efficiency will improve, however - 
if it is made about 1/10 magnitude of about 4 K bytes, applying picture compression - in all [ both / 
buffer ] ~ about four frames will collect. If it transmits at the speed of five frames in 1 second, it will 
become the delay for about 1 second only now. 

[0058] However, if a buffer is conversely made small not much, since transfer efficiency will worsen, 
here is a trade-off. The size of this transmission and a receive buffer can be changed functionally 
(setsockopt). 

[0059] 4. The evaluation at the time of mounting the evaluation information processor of an information 
processor on a workstation is as follows. 

[0060] 4.1 it considered as the example which considered measurement of transfer delay and 
effectiveness as the size of a transceiver buffer at a transceiver buffer, transfer delay, and the 
effectiveness actual condition, and the dynamic-image data transfer was performed between two 
workstations connected to the same network. Here, a workstation is connected with Ethernet, resolution 
is transmitted and measured by 160x120, no compressing [ with a depth of 16 bits ], and the JPEG 
compression image, and size of one frame is made into about 38 K bytes by no compressing, and makes 
it about 5 K bytes by JPEG compression. 

[0061] Moreover, transfer delay set the clock using the function (timed (8)), and measured time amount 
until it performs a transfer from image incorporation and displays by remote **. Furthermore, the 
maximum transfer frame rate is measured as transfer efficiency. The transceiver buffer size of the image 
of no compressing and the JPEG compression to drawing 7 and the relation of transfer delay and 
effectiveness are shown in drawing 6 . 

[0062] As shown in drawing 6 , when the magnitude of one frame is large, since one frame has not gone 
into a transceiver buffer, the difference of the transfer delay to the size of a buffer hardly changes by no 
compressing. When buffer size is 8 K bytes, a result with sufficient transfer delay and effectiveness 
appears. According to this drawing 6 , 8 K bytes also shows that effectiveness becomes [ the transfer by 
TCP/IP ] good most in that case in default transceiver buffer size. 

[0063] When transmitting the image which performed JPEG compression shown in drawing 7 compared 
with it, in order for software to perform compression elongation of JPEG, there are few maximum frame 
rates. Moreover, since a transceiver buffer is covered with several frames, delay increases, so that the 
size of a buffer is large. Then, media data transfer delay can be shortened by compressing JPEG etc., and 
making buffer size of transmission and reception small to extent in which transfer efficiency does not 
fall, when image data is sufficiently smaller than a network bandwidth. 

[0064] 4.2 In the same environment as screen transfer speed, a screen size, a frame rate, and transfer 
delay are measured. First, when Ethernet was used as a network, the result of the next table was 
obtained. The transfer maximum frame rate of the image which carried out JPEG compression, and the 
engine performance of delay are shown in a non-compressed image with a depth of 16 bits and Table 2 
in Table 1. 
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[0067] Next, it is a service synthesis digital network (ISDN:integratedservice digitial network) as a 
network. The engine performance at the time of using IB (64K) becomes as it is shown in Table 3. In 
addition, when ISDM was used, when image data was not compressed, the frame rate was set to 0.2 
(fps) also in the minimum screen size (80x60), and since it was not practical, evaluation of the transfer 
engine performance of a non-compressed image with a depth of 16 bits was excluded. 



[0068] 
Table 3] 
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[0069] By using such an information processor, creation of multimedia application was attained easily, 
without being conscious of incorporation of an image and voice, compression elongation, and network 
programming. 

[0070] 4.4 In the information processor of ****** synchronous [ between media ], the synchronization 
was taken, and media data are interleaved and transmitted to the single stream. Moreover, since TCP/IP 
is used as a network protocol, the sequence of a packet is guaranteed. Furthermore, if two or more media 
data are incorporated to coincidence, it interleaves to it and a synchronization can be guaranteed at the 
time of data transmission, even a data receiving area can assume the synchronization of two or more 
media data to be what can be taken. The synchronization of the media data of the voice actually 
transmitted on the single network by this approach and an animation brought a satisfying result. 
[0071] 4.5 Use standard TCP/IP by UNIX of an operating system as a network protocol by the relation 
above-mentioned mounting with delay. Here, as shown in drawing 8 , in the environment where media 
data can be sent directly, an information processor can control the buffer of a transmitting side and a 
receiving side, and fine control of flow can be performed in it. 

[0072] The receiving set of this invention example which realizes concretely hereafter what returned and 
mentioned above to drawing 1 is explained. In drawing 1 , the sound signal and video signal from a 
microphone 1 or a video camera 2 are sent to the A/D-conversion compression circuits 3 and 4. As 
mentioned above, the above-mentioned A/D-conversion compression circuit 3 is compressed using 
G.71 1, G.721, G.722, G.728, etc. as an audio compression method, while carrying out A/D conversion 
of the sound signal and digitizing it. Moreover, in the above-mentioned A/D-conversion compression 
circuit 4, while carrying out A/D conversion of the video signal and digitizing it, as mentioned above, it 
compresses, using JPEG, H.261, or the MPEG etc. as a compression method of an image. 
[0073] The multiplexer of the voice data and image data which were compressed from these 
compression circuits 3 and 4 is carried out by the multiplexer 5, they are sent after that to the network 
transmitting section 7 through the data buffer memory (for example, FIFO memory) 6, and are sent to 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



4/12/06 



JP,07-170503,A [DETAILED DESCRIPTION] 



Page 9 of 13 



the network receive section 1 1 of a receiving side through the networks 8, such as Ethernet, from the 
network transmitting section 7 concerned. 

[0074] Moreover, in the configuration of the transmitting side of this drawing 1 , text data, program 
data, numeric data, other binary data, etc. are supplied to an input terminal 89 as a signal except the 
signal of the above-mentioned voice or an animation. These data are further outputted from the network 
transmitting section 7 through a multiplexer 5, after processing of an error correcting code being added 
in the data-processing circuit 94 is performed. 

[0075] It separates into the voice data and image data by which compression was carried out [ above- 
mentioned ] in the separation circuit 12, and the data received in the network receive section 1 1 of the 
receiving side concerned are sent to the voice data buffer memory (FIFO memory) 13 and the image 
data buffer memory (FIFO memory) 14 which correspond, respectively. As for the above-mentioned 
voice data buffer memory 13 and the image data buffer memory 14, based on the clock from the read- 
out clock generation circuits 17 and 22, read-out of data is made, respectively. 
[0076] Moreover, from the write-in address and the read-out address of the voice data buffer memory 
13, the buffer memory inner capacity measuring circuit 15 measures inner capacity of the memory 13 
concerned, and sends the measurement result to the operation decision circuit 76. 
[0077] In the operation decision circuit 76 concerned, a clock frequency correcting signal is sent to the 
read-out clock generation circuit 17 which generates the read-out clock of the above-mentioned memory 
13 based on the inner capacity measurement result of the memory 13 from the above-mentioned 
measuring circuit 15. In the read-out clock generation circuit 17 concerned, the rate of the read-out clock 
of the voice data buffer memory 13 is changed according to the above-mentioned clock frequency 
correcting signal (namely, the read-out rate of memory 13 modification). 

[0078] That is, he is trying to adjust the consumption of the storage capacity of the voice data buffer 
memory 13 concerned with this example equipment by performing control which changes a read-out 
clock rate according to the inner capacity of the voice data buffer memory 13. For example, inner 
capacity of the voice data buffer memory 13 concerned is lessened by controlling to make a read-out 
clock rate quick, when the inner capacity of the voice data buffer memory 13 increases too much, and 
when there is too little inner capacity of buffer memory 13 conversely, inner capacity of buffer memory 
13 is made [ many ] by controlling to make the rate of a read-out clock late. By doing in this way, the 
time lag and time lag from the input in the voice data buffer memory 13 concerned to an output are 
recovered to a proper value. 

[0079] In the above-mentioned buffer memory inner capacity measuring circuit 15 and the operation 
decision circuit 76 for voice data, the inner capacity of the voice data buffer memory 13 is measured, 
and it is made to adjust the above-mentioned read-out rate with a flow chart as shown in drawing 9 here. 

[0080] In this drawing 9 , the measured value S of the inner capacity of the buffer memory 13 of voice 
data (a unit is playback time amount) is calculated at step SI. In addition, the above-mentioned 
measured value S is calculated by the following formulas. 

S= {(buffer read-out address) -(buffer write-in address) * frame period} /(amount of data of one frame) 
[0081] At the following step S2, when S>Smax is judged from measured value S and the upper limit 
Smax of the proper range of the inner capacity of the buffer memory 13 of voice data concerned and it 
judges with no, it progresses to step S22, and when it judges with yes conversely, it progresses to step 
S21. 

[0082] At the above-mentioned step S21, only P increases the frequency of the read-out clock of the 
buffer memory 13 of voice data. In addition, the value of this P is made into 1%. 
[0083] Moreover, if it is judged no at the above-mentioned step S2 and progresses to step S22, at this 
step S22, S<Smin will be judged from the above-mentioned measured value S and the lower limit Smin 
of the proper range of the inner capacity of the buffer memory 13 of voice data. At the step S22 
concerned, when it judges with no and return and yes are judged to step SI, it progresses to step S23. 
[0084] At step S23, only P reduces the frequency of the read-out clock of the buffer memory 13 of voice 
data. The value of P at this time is also made into 1%. After this step S23 returns to step SI. 
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[0085], In addition, if the proper value of the proper range of the inner capacity of the buffer memory 13 
of voice data is set to Ssta, the relation between the above-mentioned upper limit Smax, the above- 
mentioned proper value Ssta, and a lower limit Smin will serve as Smin<Ssta<Smax. 
[0086] On the other hand, the buffer memory inner capacity measuring circuit 20 measures inner 
capacity of the memory 14 concerned from the write-in address and the read-out address of the image 
data buffer memory 14, and sends the measurement result to the operation decision circuit 81. 
[0087] In the operation decision circuit 81 concerned, a clock frequency correcting signal is sent to the 
read-out clock generation circuit 22 which generates the read-out clock of the above-mentioned memory 
14 based on the inner capacity measurement result of the memory 14 from the above-mentioned 
measuring circuit 20. In the read-out clock generation circuit 22 concerned, the rate of the read-out clock 
of the voice data buffer memory 14 is changed according to the above-mentioned clock frequency 
correcting signal (namely, the read-out rate of memory 14 modification). 

[0088] That is, he is trying to adjust the consumption of the storage capacity of the image data buffer 
memory 14 concerned with this example equipment by performing control which changes a read-out 
clock rate according to the inner capacity of the image data buffer memory 14. For example, inner 
capacity of the image data buffer memory 14 concerned is lessened by controlling to make a read-out 
clock rate quick, when the inner capacity of the image data buffer memory 14 increases too much, and 
when there is too little inner capacity of buffer memory 14 conversely, inner capacity of buffer memory 
14 is made [ many ] by controlling to make the rate of a read-out clock late. By doing in this way, the 
time lag and time lag from the input in the voice data buffer memory 14 concerned to an output are 
recovered to a proper value. 

[0089] In the above-mentioned buffer memory inner capacity measuring circuit 20 and the operation 
decision circuit 71 for image data, the inner capacity of the image data buffer memory 14 is measured, 
and it is made to adjust the above-mentioned read-out rate with a flow chart as shown in drawing 10 
here. 

[0090] In this drawing 10 , the measured value V of the inner capacity of the buffer memory 14 of image 
data (a unit is playback time amount) is calculated at step SI 1. In addition, the above-mentioned 
measured value V is calculated by the following formulas. 

V= {(buffer read-out address) -(buffer write-in address) * frame period} /(amount of data of one frame) 
[0091] At the following step SI 2, when V>Vmax is judged from measured value V and the upper limit 
Vmax of the proper range of the inner capacity of the buffer memory 14 of image data concerned and it 
judges with no, it progresses to step S32, and when it judges with yes conversely, it progresses to step 
S31. 

[0092] At the above-mentioned step S31, only P increases the frequency of the read-out clock of the 
buffer memory 14 of image data. In addition, the value of this P is made into 1%. 
[0093] Moreover, if it is judged no at the above-mentioned step S12 and progresses to step S32, at this 
step S32, V<Vmin will be judged from the above-mentioned measured value V and the lower limit 
Vmin of the proper range of the inner capacity of the buffer memory 14 of image data. At the step S32 
concerned, when it judges with no and return and yes are judged to step SI 1, it progresses to step S33. 
[0094] At step S3 3, only P reduces the frequency of the read-out clock of the buffer memory 14 of 
image data. In addition, the value of this P is also made into 1%. After this step S33 returns to step SI 1 . 
[0095] In addition, if the proper value of the proper range of the inner capacity of the buffer memory 14 
of image data is set to Vsta, the relation between the above-mentioned upper limit Vmax, the above- 
mentioned proper value Vsta, and a lower limit Vmin will serve as Vmin<Vsta<Vmax. 
[0096] The voice data read from the voice data buffer memory 13 by which it reads as mentioned above 
and a rate is controlled, or the image data buffer memory 14, and image data are sent to the elongation 
D/A conversion circuits 18 and 19 which perform the elongation processing and D/A conversion which 
correspond, respectively. In these elongation D/A conversion circuits 18 and 19, it is given, respectively, 
and the elongation processing corresponding to each compression processing in said A/D-conversion 
compression circuits 3 and 4 carries out D/A conversion after that, and outputs. 
[0097] The sound signal from the above-mentioned elongation D/A conversion circuit 18 is sent to a 
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loudspeaker 27, and the video signal from the above-mentioned elongation D/A conversion circuit 19 is 
sent to the monitor display 24. 

[0098] Moreover, the input signal supplied to the above-mentioned separation circuit 12 is sent also to 
said detector 25 through the separation circuit 12 concerned. In the detector 25 concerned, voice and a 
signal like for example, the above-mentioned text data, program data, numeric data, and other binary 
data as a signal except the signal of an animation are detected from the above-mentioned input signal. 
[0099] If the data except the signal of the above-mentioned voice or an animation are detected in this 
detector 25, from the detector 25 concerned, a detecting signal will be outputted to the above-mentioned 
separation circuit 12. If the detecting signal from the above-mentioned detector 25 is supplied, the 
above-mentioned separation circuit 12 will separate only the data according to the detecting signal 
concerned from the above-mentioned input signal, and will send them to the data-processing circuit 26. 
[0100] In the data-processing circuit 26 concerned, after performing predetermined processing to the 
supplied data, it outputs from an output terminal. In addition, as the above-mentioned predetermined 
processing, error correction processing etc. can be mentioned, for example. 

[0101] Thus, in the receiving side of this example, when it has the above-mentioned detector 25 and the 
above-mentioned separation circuit 12 separates data excluding voice and an animation from an input 
signal according to the detecting signal from the detector 25 concerned, it is possible to perform 
processing according to the data except these voice or an animation. 

[0102] Moreover, the data of the voice separated in the separation circuit 12 of the receiving set of this 
example and an image are also sent to the above-mentioned detector 25. 

[0103] As opposed to voice data, in consideration of human being's acoustic-sense property, a low-pass 
part is detected from the voice data concerned, or an important voice part is especially detected like the 
part of human being's voice in the above-mentioned detector 25 at this time. Moreover, as opposed to 
image data, in consideration of human being's vision property, an important image part is especially 
detected visually from the image data concerned, or an important part is especially detected from the 
contents of an image. From this detector 25, a detecting signal is respectively sent to the above- 
mentioned operation decision circuits 67 and 81 for the above-mentioned voice data and image data. 
[0104] If the detecting signal from the above-mentioned detector 25 is received, it will control by the 
above-mentioned operation decision circuit 76 for the above-mentioned voice data to be sent to the 
elongation D/A conversion circuit 18 of latter voice data as it is from the above-mentioned voice data 
buffer memory 13 about the important part of the voice corresponding to control by which the voice part 
corresponding to the above-mentioned detecting signal is not canceled in the voice data buffer memory 
13, i.e., the above-mentioned detecting signal. Rationalization of the inner capacity of the buffer 
memory 13 concerned can be attained by on the other hand, canceling to the data of the voice except 
these important parts, when the inner capacity of buffer memory 13 exceeds said upper limit, for 
example. 

[0105] Since a proper value can be made to recover the time lag from the input of the above-mentioned 
buffer memory 13 to an output and it is not canceled about the important part of the above-mentioned 
voice in the receiving set of this example even if such, the voice outputted from the next loudspeaker 27 
can maintain high quality. 

[0106] On the other hand, if the detecting signal from the above-mentioned detector 25 is received, it 
will control by the above-mentioned operation decision circuit 81 for the above-mentioned image data to 
be sent to the elongation D/A conversion circuit 19 of latter voice data as it is from the above-mentioned 
image data buffer memory 14 about the important part of the image corresponding to control by which 
the image part corresponding to the above-mentioned detecting signal is not canceled, i.e., the above- 
mentioned detecting signal. Moreover, rationalization of the inner capacity of the buffer memory 14 
concerned can be attained by canceling to the data of the image except these important parts, when the 
inner capacity of buffer memory 14 exceeds said upper limit, for example. 

[0107] Thereby, in the receiving set of this example, since a proper value can be made to recover the 
time lag from the input of the above-mentioned buffer memory 14 to an output and it is not canceled 
about the important part of the above-mentioned image, the image displayed on the next monitor display 
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24 can maintain high quality. 

[0108] Next, the configuration of other examples of this invention is shown in drawing 1 1 . 
[0109] In this drawing 1 1 , the monitor display 40, a microphone 41, and a video camera 42 are 
connected to a transmitting-side host computer, and it connects with a receiving-side host computer 
through a network 43 . 

[01 10] In the transmitting-side host computer concerned, using the program data currently held at main 
memory 31, each part is controlled and CPU30 performs various kinds of operations. In addition, this 
CPU30 also has a function as a data-processing circuit 94 of drawing 1 . 

[0111] Compression processing for image data which was mentioned above while A/D conversion was 
carried out by the A/D-conversion compression processing section 38 is performed, and the video signal 
from a video camera 42 is stored in buffer memory 34 temporarily. Moreover, compression processing 
for voice data which was mentioned above while A/D conversion was carried out by the A/D-conversion 
compression processing section 37 is performed, and the sound signal from a microphone 41 is stored in 
buffer memory 33 temporarily. 

[01 12] Moreover, the image frame data formed of CPU30 and the image frame data based on the image 
photoed with the video camera 42 are memorized by the frame memory 32. The image frame data from 
the frame memory 32 concerned are sent and displayed on the monitor display 40 through the display 
interface 36. 

[01 13] Furthermore, the voice data and image data which were stored in the above-mentioned buffer 
memory 33 and 34 and which were compressed are read, once it is stored in buffer memory 35 after a 
multiplexer is carried out by CPU30. The data read from the buffer memory 35 concerned are sent to a 
receiving-side host computer through the network 43 connected to the network interface 39. 
[0114] Moreover, the monitor display 61 and a loudspeaker 62 are connected to a receiving-side host 
computer, and it connects with a transmitting-side host computer through a network 43 further. 
[0115] In the receiving-side host computer concerned, using the program data currently held at main 
memory 53, each part is controlled and CPU52 performs various kinds of operations. Moreover, this 
CPU52 also has a function as said buffer inner capacity measuring circuits 15 and 20, the operation 
decision circuits 76 and 81, and read-out clock generation circuits 17 and 22, therefore makes 
measurement of the buffer memory inner capacity of said drawing 1 , frequency correction of a read-out 
clock, etc. 

[01 16] The data sent from the above-mentioned transmitting-side host computer through the above- 
mentioned network 43 are read once it is stored in buffer memory 5 1 through a network interface 50. 
[01 17] From the received data read from the buffer memory 51 concerned, the voice data and image data 
compression was carried out [ data / above-mentioned ] by CPU52 are separated, and it is sent to the 
buffer memory 54 and 55 which corresponds, respectively. 

[01 18] The compressed image data which were sent to buffer memory 54 are read from the buffer 
memory 54 concerned, are sent to the data elongation processing section 56, and the elongation 
processing corresponding to compression with the above-mentioned transmitting-side host computer is 
made. The elongated image data concerned are stored in a frame memory, are made with a frame, and 
are sent and displayed on the monitor display 61 through the display interface 58. 
[0119] Moreover, the compressed voice data which was sent to buffer memory 55 is read from the 
memory 55 concerned, is sent to the data elongation processing section 59, and the elongation 
processing corresponding to compression with the above-mentioned transmitting-side host computer is 
made. After the elongated voice data concerned is changed into the sound signal of an analog by the 
D/A transform-processing section 60, it is sent to a loudspeaker 62. 

[0120] The elongation processing time concerned of the signal with which elongation processing is 
made according to each example equipment of this invention as mentioned above (namely, playback 
time amount), The difference (measured value S and V of the inner capacity of a buffer) with the time 
amount by which the transmit data sent from a transmitting side is received crossed the inside of the 1st 
time amount (the upper limits Smax and Vmax of the proper range of the inner capacity of a buffer), Or 
if it detects that it was less than the inside of the 2nd time amount (the lower limits Smin and Vmin of 
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the proper range of the inner capacity of a buffer) Since it is made to perform control which constitutes 
the difference of the time amount of the above-mentioned elongation processing, and time of delivery in 
the 1st time amount and the 2nd time amount (the upper limits Smax and Vmax of the proper range of 
the inner capacity of a buffer) (lower limits Smin and Vmin) It becomes possible to make an 
abbreviation proper value (Ssta, Vsta) recover the time lag from the input of buffer memory 13 and 14 
or buffer memory 54 and 55 to an output. Therefore, in each example equipment, it becomes possible to 
lessen the time lag from the input of buffer memory 13, 14, 54, and 55 to an output, and to also make 
small the time lag between the media in an output. 

[0121] Moreover, in the receiving set of this example, when the data detector 25 is formed and an input 
signal detects that it is data except voice and an animation by this data detector 25, when an input signal 
is for example, the above-mentioned text data etc., it has prevented the contents of data changing by 
having made it process as it is in the data-processing circuit 26. 

[0122] furthermore, in the receiving set of this example, when a detector 26 detects an important part 
especially in voice and an image from an input signal By making other parts except these important 
parts discard to the voice data buffer memory 13 and the image data buffer memory 14 in the operation 
decision circuits 76 and 81 It is making it make a proper value recover the time lag from the input of 
these buffer memory 13 and 14 to an output, and processing the above; especially an' important part as it 
is, and has prevented being canceled about the signal of this part. 
[0123] 

[Effect of the Invention] It sets to the receiving set of this invention as mentioned above. A control 
means The difference of the playback time amount of an input signal and the received time amount 
crossed the inside of the 1st time amount, Or if it is detected that it was less than the inside of the 2nd 
time amount, since it will be made to perform control which constitutes the difference of the playback 
time amount of the time amount reproduced, and the time amount received in the 1st time amount and 
the 2nd time amount, it becomes possible to make a proper value recover the time lag from the input of a 
buffer means to an output of it. That is, in this invention equipment, even if data processing in a 
receiving side is overdue and the time lag from the input in a buffer means to an output becomes large 
by fluctuation of a load, it becomes possible to recover a time lag automatically. Moreover, it is 
automatically recoverable, even if data processing in a receiving side is overdue and the time lag 
between the buffer means in an output becomes large by fluctuation of a load. 
[0124] Moreover, in the receiving set of this invention, when the 3rd detection means is established 
further and an input signal detects that they are voice and/or a signal except the signal of an animation 
with this 3rd detection means, it can prevent that the contents of data change by processing as it is when 
an input signal is text data etc. 

[0125] Furthermore, when according to the receiving set of this invention the 4th detection means is 
established further and this 4th detection means detects the predetermined part of an input signal, it is 
processing that predetermined part as it is about other parts except that predetermined part, and can 
prevent being canceled about the signal of this predetermined part. 
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http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 



4/12/06 



JP,07-170503,A [DESCRIPTION OF DRAWINGS] 



Page 1 of 2 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block circuit diagram showing the receiving set of this invention example, and the 

outline configuration of the equipment of the transmitting side corresponding to this. 

[Drawing 2] It is drawing showing the model of the information processor of the information processing 

communication system with which this invention equipment is applied. 

[Drawing 3] It is drawing for explaining a multimedia data transfer. 

[Drawing 4] It is drawing for explaining the multimedia data transfer between the hosts connected in the 
network. 

[Drawing 5] It is drawing for explaining positioning of the information processor in the whole system. 
[Drawing 6] It is the property Fig. showing the relation between the transceiver buffer size in not 
compressing, and transfer delay and effectiveness. 

[Drawing 7] It is the property Fig. showing the relation between the transceiver buffer size of the image 
of JPEG compression, and transfer delay and effectiveness. 

[Drawing 8] It is drawing for explaining the relation between an information processor and delay. 

[Drawing 9] It is a flow chart for explaining the inner capacity measurement of voice data buffer 

memory and the processing of clock frequency correction in this example receiving set. 

[Drawing 10] It is a flow chart for explaining the inner capacity measurement of image data buffer 

memory and the processing of clock frequency correction in this example receiving set. 

[Drawing 11] It is the block circuit diagram showing the outline configuration of the transmitting-side 

host computer of other examples of this invention, and a receiving-side host computer. 

[Drawing 12] It is the block circuit diagram showing the outline configuration of the conventional 

sending set and a conventional receiving set. 

[Description of Notations] 

1 41 ... Microphone 

2 42 ... Video camera 

3 ... Audio A/D-conversion compression circuit 

4 ... A/D-conversion compression circuit of an image 

5 ... Multiplexer 

6 ... Data buffer memory 

7 ... Network transmitting section 

8 ... Network 

9 ... Network receive section 

12 ... Separation circuit 

13 ... Voice data buffer memory 
14... Image data buffer memory 

15 20 ... Buffer memory inner capacity measuring circuit 

17 22 ... It begins to read and is a clock generation circuit. 

18 ... Elongation D/A conversion circuit of voice data 



http://www4.ipdl.ncipi.go.jp/cgi-bin/tran_web_cgi_ejje 4/12/06 



JP,07-1 70503 ,A [DESCRIPTION OF DRAWINGS] 



Page 2 of 2 



19 ... Elongation D/A conversion circuit of a video data 
24, 40, 61 ... Monitor display 

25 ... Detector 

26 ... Data-processing circuit of a receiving side 

27 62 ... Loudspeaker 
30 ... CPU 

31 53 ... Main memory 

32 57 ... Frame memory 

33, 34, 35, 51, 54, 55 ... Buffer memory 

36 58 ... Display interface 

37 ... Voice data A/D-conversion compression zone 

38 ... Video data A/D-conversion compression zone 
56 ... The data elongation section for voice data 

59 ... The data elongation section for image data 

60 ... Voice data D/A transducer 
76 81 ... Operation decision circuit 

94 ... Data-processing circuit of a transmitting side 



[Translation done.] 
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